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Chromatic and High-frequency cVEP-based BCI Paradigm 
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Abstract —We present results of an approach to a code- 
modulated visual evoked potential (cVEP) based brain- 
computer interface (BCI) paradigm using four high-frequency 
flashing stimuli. To generate higher frequency stimulation com¬ 
pared to the state-of-the-art cVEP-based BCIs, we propose 
to use the light-emitting diodes (LEDs) driven from a small 
micro-controller board hardware generator designed by our 
team. The high-frequency and green-blue chromatic flashing 
stimuli are used in the study in order to minimize a danger of a 
photosensitive epilepsy (PSE). We compare the the green-blue 
chromatic cVEP-based BCI accuracies with the conventional 
white-black flicker based interface. The high-frequency cVEP 
responses are identified using a canonical correlation analysis 
(CCA) method. 

I. INTRODUCTION 

A brain computer interface (BCI) is a technology that 
utilizes human neurophysiological signals for a direct 
brainwave-based communication with an external environ¬ 
ment, and without depending on any muscle or peripheral 
nervous system activities [1]. Particularly, in the case of 
patients suffering from locked-in-syndrome (LIS) [2], such 
technology could help them to communicate or complete 
various daily tasks (type messages on a virtual keyboard 
or control their environment using a computer, etc). This 
technology shall create a feasible option for amyotrophic 
lateral sclerosis (ALS) or coma patients to communicate with 
their families, friends or caretakers by using their brainwaves 
only [1]. 

In this paper, we report on the visual BCI paradigm, which 
has been inspired by the three seminal papers in this field, 
namely a code-modulated visual evoked potential (cVEP) 
response-based BCI reported in [3]; a steady-state visual 
evoked potential (SSVEP) classification with a canonical 
correlation analysis (CCA) [4]; and a green-blue flashing- 
based SSVEP BCI [5]. The chromatic green-blue cVEP 
stimulus brings a new option of a lower danger of the a 
photosensitive epilepsy (PSE) [6], [7] seizures comparing to 
the classical SSVEP based BCI paradigms [5], [8], [9]. The 
flashing frequencies in a range of 15 ~ 25 Hz are the most 

*This research was supported in part by the Strategic Information and 
Communications R&D Promotion Program (SCOPE) no. 121803027 of The 
Ministry of Internal Affairs and Communication in Japan, and by KAK- 
ENHI, the Japan Society for the Promotion of Science, grant no. 24243062. 

^Daiki Aminaka, Shoji Makino and Tomasz M. Rutkowski are with 
Life Science Center of TARA and Department of Computer Sci¬ 
ence, University of Tsukuba, 1-1-1 Tennodai Tsukuba Ibaraki, Japan. 
tomek@bci-lab.info http://bci-lab.info/ 

^Tomasz M. Rutkowski is also with RIKEN Brain Science Institute, 
Wako-shi, Japan. 

^Tomasz M. Rutkowski is the con'esponding author. 

‘Tomasz M. Rutkowski was supported in pair by YAMAHA Corporation. 


provocative for the PSE (the frequencies of 5 ~ 65 Hz are 
still dangerous) [6]. 

We also propose to employ the light-emitting diodes 
(LEDs) for the code modulated visual evoked potential 
(cVEP) generation with an application of higher flashing 
frequencies (40 Hz), comparing to the classical computer 
display (with limited refreshing rates allowing for at maxi¬ 
mum 30 Hz stimulus generation) approaches [1], [8], [10]. 
The higher flashing frequencies allow for an increase of 
an information transfer rates (ITR), of which low scores 
were a limitation of the state-of-the-art cVEP-based BCI 
paradigm [3]. The cVEP is a natural response for the visual 
stimulus with specific code-modulated sequences [3], [10]. 
It is generated by the brain when the user gazes at light 
source which flashes the specific code-modulated sequence. 
The cVEP-based BCI belongs to the stimulus-driven BCIs, 
which do not required longer training comparing to the 
imagery-driven paradigms [1]. In order to further confirm 
results from the recent studies on the chromatic (green- 
blue) flashing-based paradigms [5], [9], we compare in this 
paper the proposed BCI paradigm with a classical white- 
black cVEP modality. 

Prom now on the paper is organized as follows. In the 
next section we describe materials and methods used in this 
study. Discussion of the obtained results follows and conclu¬ 
sions, together with future research directions, summarize the 
paper. 

H. MATERIALS AND METHODS 

The experiments reported in this paper were performed in 
the Life Science Center of TARA, University of Tsukuba, 
Japan. All the details of the experimental procedures and 
the research targets of the cVEP-based BCI paradigm were 
explained in detail to the eight users, who agreed voluntarily 
to participated in the study. The electroencephalogram (EEG) 
cVEP-based BCI experiments were conducted in accordance 
with The World Medical Association Declaration of Helsinki 
- Ethical Principles for Medical Research Involving Human 
Subjects. The experimental procedures were approved and 
designed in agreement with the ethical committee guidelines 
of the Paculty of Engineering, Information and Systems 
at University of Tsukuba, Tsukuba, Japan (experimental 
permission no. 2013R7). The average age of the users was 
of 26.9 years old (standard deviation of 7.3 years old; seven 
males and one female). 

The visual stimuli were flashed via the RGB LEDs as 
square waves generated by the ARDUINO UNO micro¬ 
controller board as shown in Eigure[T] The generator program 
was written by our team using C-language. In this study 
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Fig. 1. A diagram explaining a difference in flashing stimuli between 
the conventional monochromatic (white-black) and the proposed chromatic 
(green-blue) flickering patterns created with square cVEP-modulated waves 
generated by the ARDUINO UNO micro-controller board in the presented 
study. 
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we used m — sequence encoded flashing patterns [3] to 
create four commands of the cVEP-based BCI paradigm. 
The m — sequence is a binary pseudorandom sequence, 
which could be generated using the follwoing equation, 

x{n) = x{n — p) (B x{n — q), {p > q) (1) 

where x{n) is the element of the m — sequence obtained 
by the exclusive-or (XOR) operation, denoted by 0 , using 
the two preceding elements indicated by p and q. In this 
project p = 5 and q = 2 were chosen. An initial binary 
sequence was chosen, to create the full m — sequence used 
in the equation ([T]), as follows, 

= [ 0 , 1 , 0 , 0 , 1 ]. ( 2 ) 

Finally, the 31 bits long sequence was generated based on 
the above initial sequence as in equation 0 and depicted as 
a vector Si in Figure 

The interesting m — sequence feature, which is very 
useful for the cVEP-based BCI paradigm design, is an 
unique autocorrelation function. The autocorrelation function 
has only a single peak at the period sample value. If the 
m — sequence period is N, the autocorrelation function 
will result with values equal to 1 at 0, V, 27V,... and 1/N 
otherwise. It is also possible to introduce a circular shift 
of the TO — sequence denoted by r, to create a set of 
TO — sequences with also shifted autocorrelation functions, 
respectively. In this study, the shifted time length has been 
defined as t = 7 bits. Three additional sequences has been 
generated using shifting by r, 2 • r and 3 • r, respectively, as 
shown also in Figure During the online cVEP-based BCI 
experiments the four LEDs continued to flash simultaneously 
using the time-shifted to — sequences as explained above. 
Two TO — sequence period lengths have been tested to 
investigate whether they would affect the cVEP response? 
The conventional full m —sequence period of T = 516.7 ms 
(based on the conventional computer screen refresh rate of 
60 Hz and referred as “a low flashing frequency”) and the 
proposed T = 387.5 ms (referred as “a high flashing fre¬ 
quency”) have been tested. The two monochromatic (white- 
black) and chromatic (green-blue) LEDs for the proposed 
cVEP-based BCI settings used in the experiments reported in 


Fig. 2. A diagram illustrating a procedure to construct four m — sequences 
denoted by s^, (i = 1, 2, 3,4). Each sequence is shifted by r = 7 bits and it 
has a period T. The traces denoted by yj, (j = 1, 2, 3, 4) are the averaged 
EEG cVEP responses. 


this paper are presented in Figure]^ During the cVEP-based 
BCI EEG experiments the users were seated on a comfortable 
chair in front of the LEDs (see Figure [^. The distance 
between user’s eyes and LEDs was about 30 ^ 50 cm 
(chosen by the users for a comfortable view of all LEDs). 
An ambient light was moderate as in a typical office. The 
EEG signals were captured with a portable EEG amplifier 
system g.USBamp from g.tec Medical Engineering, Austria. 
Eight active wet (gel-based) g.LADYbird EEG electrodes 
were connected to the head locations as in an extended 
10/10 international system [1]. These positions were decided 
due to the visual cortex responses targeting experiment [1]. 
Details of the EEG experimental set up are summarized in 
Table The sampling frequency was set to 512 Hz and a 
notch 4*^ order Butterworth HR Alter at rejection band of 
48 ^ 52 Hz was applied to remove power line interference 
of 50 Hz. Moreover, the 8*^ order Butterworth HR band¬ 
pass Alter at pass band of 5 ^ 100 Hz was applied to 


TABLE I 

EEG EXPERIMENT CONDITION DETAILS 


Number of users 

8 

Single session length 

8 and 11 seconds 

m — sequence lengths T 

516.7 and 387.5 ms 

Shifts r 

116.7 and 87.5 ms 

EEG recording system 

g.USBamp by g.tec with active wet 
(gel-based) g.LADYbird electrodes 

EEG electrode locations 

01,02, Po3, Po4, PI, P2, Oz 

and Poz 

Reference and ground 

Left earlobe and FPz 

Notch filter 

Butterworth 4*^ order with rejection 
band of 48 52 Hz 

Band-pass filter 

Butterworth 8*^ order with pass 
band of 5 100 Hz 

LED positions 

45.5 X 41.5 cm rectangle edge centers 




















































Fig. 3. The visual stimulation device used in the presented study. The top, 
bottom, right and left LEDs’ flickering patterns correspond to Si,{i = 
1,2,3, 4) m — sequences, respectively (see the m — sequence shifted 
patterns Figure]^. The LEDs were arranged at edge centers of the 45.5 X 
41.5 cm rectangular frame as shown in the above photograph. 


remove eye blinks and high frequency muscle-originating 
noise. The OpenViBE [11] bio-signal data acquisition and 
processing environment, together with in-house programmed 
in Python extensions, were applied to realize the online 
cVEP-based BCI paradigm. To avoid user’s eye blinks, each 
trial to gaze at a single LED was separated with pauses 
during the experimental sessions (sessions length details 
in Table [I]i. All the participating users were instructed not 
to move their neck when changing their eye-gaze among 
the four LEDs to reduce electromyographic noise. No eye- 
movement interference affected the proposed cVEP BCI. 
In the data acquisition phase, first the users gazed at top 
flashing LED in order to collect classifier training dataset, as 
instructed verbally by the experimenter conducting the study. 
Twenty m — sequence cycles were repeated in a single EEG 
capturing session. In short, sixty cVEPs to m — sequence 
based flashing were collected for each direction in a single 
experimental trial. The triggers indicating the onsets of the 
m — sequences were sent to g.USBamp directly from the 
ARDUINO UNO micro-controlled to mark the beginning of 
each cVEP response. Einally, four experiment types were 
conducted for each user: the conventional low frequency; the 
proposed high frequency; and in each above setting in the 
two color modes using white-black and green-blue flashing 
LEDs. 

A canonical correlation analysis (CCA) [4] method was 
used in this study to classify the cVEP responses based on 
the user’s intentional choices (gazes). In the training session a 
single dataset containing the cVEP responses to top flashing 
LED was used. The remaining three cVEP responses were 
constructed by shifting the top LED response by r, 2 • r 
and 3 • r (see Eigurej^for stimulus design explanation). We 
applied an analysis of multichannel correlation coefficients 
among the reference m— sequences and captured cVEPs [3]. 
We used the CCA method to identify the gazed by the 
user flickering patterns. The cVEP response processing and 


classification steps were as follows: 

1) Capturing the EEG cVEPs y^, (i = 1, 2, 3,4) obtained 
in response to time shifted m — sequences (see 
Eigurej^for stimulus creation details). 

2) Averaging the captured j cVEPs as for each 

target i separately. The averaged responses yt were 
defined as the reference data. In this study, the number 
of cVEPs was N = 60. The averaging procedure was 
as follows, 

1 ^ 
i=i 

3) Eor the test purposes, M, [M ^ iV), cVEPs recorded 
in separate sessions were used for the method evalua¬ 
tion. In this study M = 5. The averaged test datasets 
were calculated as follows. 


Zfc.Z = 


^ l+M-l 
m—l 


(4) 


where k = 1,2,3,4 represented the stimulus number 
and I — 1,2,..., N — M + I was the test dataset 
number. 

4) In order to identify (classify) the attended stimulus the 
CCA was calculated for test Zk,i versus the reference 
Yi datasets as. 


Pi = 






(5) 


where the Rzkuyu Rzk.i^kn Ryiyi were the respec¬ 
tive covariance matrices; a and b were the canonical 
correlation vectors. The maximum value of correlation 
coefficient identified by an index c was used to classify 
the attended stimuli, which pointed the correlated 
reference as. 


Pc=ma.x{pi,p2,P3,Pi}- ( 6 ) 


The results of the above procedure applied to data recorded 
in the cVEP-based BCI experiments with eight subjects are 
discussed in the following section. 


III. RESULTS 

Results of the conducted cVEP-based BCI paradigm ex¬ 
periments are summarized in form of accuracies as bar plots 
with standard errors is in Eigure The accuracies were cal¬ 
culated in experiments using the proposed green-blue high 
frequency, the green-blue conventional low frequency, the 
white-black high frequency, and the low frequency white- 
black flashing settings, respectively. The theoretical chance 
level of all experiments was of 25%. To investigate flickering 
frequency effect on cVEP classification (discriminability) ac¬ 
curacies, we applied pairwise Wilcoxon-test for a statistical 
analysis of median difference significances, because all the 
accuracy results were not normally distributed. The test was 
applied for pairs of green-blue flashing in high (40 Hz) 
versus low (30 Hz) frequencies and similarly for white-black 
setting accuracies, respectively. The results of the statistical 
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Fig. 4. The results of CCA-based classification from the eight users participating in the study presented in form of har plots with standai'd errors. There are 
four results depicted for each user, namely from the green-blue high frequency (green); green-blue conventional low frequency (light green); white-black 
higher frequency (orange); and white-black lower frequency cases (yellow), respectively. The theoretical chance level of the experiments was of 25%. 


analyses resulted with significant pgt < 0.029 for green- 
blue setting, which supported the project initial hypothesis 
of the chromatic cVEP modality feasibility. The white-black 
setting resulted with non-significant differences at a level of 
Pwb < 0.143. A comparison for significance of frequencies 
across to color settings (chromatic versus monochromatic) 
resulted with non-significant differences for high frequencies 
with phigh > 0.05. The low frequencies with significantly 
different at a level of piow < 0.034. 

IV. CONCLUSIONS 

The proposed LED flashing and cVEP response-based 
BCI paradigm with the chromatic green-blue stimuli has 
been discussed in this paper. We tested positively, for the 
online BCI feasibility, the higher frequency cVEP and CCA 
classification-based method in comparison to the classical 
low frequency cVEP stimuli. Also the the chromatic green- 
blue light effect resulted with encouraging results. 

The conducted experiments to verify the feasibility of 
the proposed method confirmed successfully our research 
hypothesis based on the results obtained from healthy eight 
users. All of the cVEP-based BCI accuracies scored above 
the theoretical chance levels and there were also 100% 
accuracies reported. 

Eor the future research, we plan to investigate upper limits 
of the stimulus frequency and an optimization of the m — 
sequences in order to create the even better visual BCI. 
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